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BoxPCT 

Assistant Commissioner for Patents 
Washington D.C. 20231 

ATTENTION: EO/US 

NOTE: T 9 avoid abandonment of the application, the applicant shall furnish to the USPTO, not later than 20 months from 
the priority date: (1) a copy of the international application, unless it has been previously communicated by the 
International Bureau or unless it was originally filed in the USPTO; and (2) the basic national fee (see 37 C.F.R § 
1.492(a)). The 30-month time limit may not be extended. 3 7 C.F.R. § 1.495. 

WARNING: Where the items are those which can be submitted to complete the entry of the international application into 

the national phase are subsequent to 30 months from the priority date the application is still considered to 
be in the international state and if mailing procedures are utilized to obtain a date the express mail 
procedure of 37 C.F.R. §1.10 must be used (since international application papers are not covered by an 
ordinary certificate of mailing -See 37 C.F.R. §1.8. 

NOTE: Documents and fees must be clearly identified as a submission to enter the national state under 35 USC371 otherwise 
the submission will be considered as being made under 35 USC111. 37 C.F.R. § 1.494(f). 



CERTIFICATION UNDER 37 CFJt. § 1.10* 

(Express Mail label number is mandatory.) 
(Express Mail ce 



I hereby certify that this paper, along with any document referred to, is being deposited with the United States Postal Service on this 
March 8,7,001 , m an envelope as "Express Mail Post Office to Addressee," mailing Label Number EL730721527US 



addressed to the: Assistant Commissioner for Patents, Washington, D.C. 2023 1 . 



(type or print name of person mailing paper) 




Certificate of mailing (first class) or facsimile tn 
of mailing or transmission for this correspondent 
Each paper or fee filed by "Express Mail" must have the number of the "Express Mail" mailing label placed thereon 
prior to mailing. 37 C.F.R. § 1.10(b). 

"Since the filing of correspondence under § 1. 10 without the Express Mail mailing label thereon is an oversight that can 
be avoided by the exercise of reasonable care, requests for waiver of this requirement will not be granted on petition " 
Notice of Oct. 24, 1996, 60 Fed. Reg. 56,439, at 56,442. 
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1. Applicant herewith submits to the United States Elected Office (EO/US) the following items 
under 35 U.S.C. 371: 

a. [X] This express request to immediately begin national examination procedures (35 

U.S.C. 371(f)). 

b. [X] The U.S. National Fee (35 U.S.C. 371(c)(1)) and other fees (37 C.F.R. § 1.492) 

as indicated below: 



2. Fees 



CLAIMS 


(1) FOR 


(2) NUMBER 


(3) NUMBER 


(4) RATE 


(5) CALCULATIONS 


FEE 




FILED 


EXTRA 






[ ]* 


TOTAL CLAIMS 


17-20 = 


0 


x $ 18.00 = 






INDEPENDENT 


4-3 = 




x $80.00 = 


$80.00 




CLAIMS 












MULTIPLE DEPENDENT CLAIM(S) (if applicable) + $270.00 


$270.00 


BASIC 
FEE** 


[ ] U.S. PTO WAS INTERNATIONAL PRELIMINARY 
EXAMINATION AUTHORITY 

Where an International preliminary examination fee as set forth in § 
1 .482 has been paid on the international application to the U.S. PTO: 
[ ] and the international preliminary examination report states 
that the criteria of novelty, inventive step (non- 
obviousness) and industrial activity, as defined in PCT 
Article 33(2) to (4) have been satisfied for all the claims 
presented in the application entering the national stage (37 

CFR 1.492(a)(4)) . $100.00 

[ ] and the above requirements are not met {37 CFR 

1.492(aXl)) $690.00 


$860.00 




[X] U.S. PTO WAS NOT INTERNATIONAL PRELIMINARY 
EXAMINATION AUTHORITY 

Where no international preliminary examination fee as set forth 
in § 1 .482 has been paid to the USPTO, and payment of an 
international search fee as set forth in § 1.445(a)(2) to the U.S. 
PTO: 

[ ] has been paid (37 CFR 1.492(a)(2)) $710.00 

[ ] has not been paid (37 CFR 1.492(a)(3)) $1000.00 

[X] where a search report on the international application has 
been prepared by the European Patent Office or the 
Japanese Patent Office (37 CFR 1.492(aX5)) $860.00 






Total of above Calculations 


= $1210.00 


SMALL 
ENTITY 


Reduction by X A for filing by small entity, if applicable. Affidavit must be filed, 
(note 37 CFR 1.9, 1.27, 1.28) 


- $ 




Subtotal 


$1210.00 




Total National Fee 


$1210.00 




Fee for recording the enclosed assignment document $40.00 (37 CFR 1 .21(h)). 
(See Item 13 below). See attached "ASSIGNMENT COVER SHEET". 




TOTAL 


Total Fees enclosed 


$1210.00 


ii. 


[X] A check in the amount of $1210.00 to cover the above fees is enclosed. 

[] Please charge Account No. in the amount of $ 



A duplicate copy of this sheet is enclosed. 
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* * WARNING: "To avoid abandonment of the application the applicant shall furnish to the United States Patent and 
Trademark Office not later than the expiration of 30 months from the priority date: * * * (2) the basic 
national fee (see § 1.492(a)). The 30-month time limit may not be extended. " 37 C.F.R. § 1.495(b). 

WARNING: If the translation of the international application and/or the oath or declaration have not been 

submitted by the applicant within thirty (30) months from the priority date, such requirements may be 
met within a time period set by the Office. 3 7 C.F.R. § 1.495(b)(2). The payment of the surcharge set 
forth in § 1.492(e) is required as a condition for accepting the oath or declaration later than thirty (30) 
months after the priority date. The payment of the processing fee set forth in § 1.492(f) is required for 
acceptance of an English translation later than thirty (30) months after the priority date. Failure to 
comply with these requirements will result in abandonment of the application. The provisions of§ 1.136 
apply to the period which is set. Notice of Jan. 3, 1993, 1147 O.G. 29 to 40. 

3. [X] A copy of the International application as filed (35 U.S.C. 371(c)(2)): 

NOTE: Section 1.495 (b) was amended to require that the basic national fee and a copy of the international application 
must be filed with the Office by 30 months from the priority date to avoid abandonment "The International 
Bureau normally provides the copy of the international application to the Office in accordance with PCT Article 
20. At the same time, the International Bureau notifies applicant of the communication to the Office. In 
accordance with PCT Rule 47. 1, that notice shall be accepted by all designated offices as conclusive evidence that 
the communication has duly taken place. Thus, if the applicant desires to enter the national stage, the applicant 
normally need only check to be sure the notice from the International Bureau has been received and then pay the 
basic national fee by 30 months from the priority date. "Notice of Jan. 7, 1993, 1147 O.G. 29 to 40, at 35-36. See 
item 14c below. 

a. [X ] is transmitted herewith. 

b. [ ] is not required, as the application was filed with the United States Receiving 

Office. 

c. [ ] has been transmitted 

i. [ ] by the International Bureau. 

Date of mailing of the application (from form PCT/IB/308): 

ii. [ ] by applicant on 

Date 

4. [X] A translation of the International application into the English language (35 U.S.C. 

371(c)(2)): 

a. [X] is transmitted herewith. 

b. [ ] is not required as the application was filed in English. 

c. [ ] was previously transmitted by applicant on 

Date 

d. [ ] will follow. 

5. [ X ] Amendments to the claims of the International application under PCT Article 19 (35 

U.S.C. 371(c)(3)): 

NOTE: The Notice of January 7, 1993 points out that 37 C.F.R. § 1.495(a) was amended to clarify the existing and 

continuing practice that PCT Article 19 amendments must be submitted by 30 months from the priority date and 
this deadline may not be extended. The Notice further advises that: "The failure to do so will not result in loss of 
the subject matter of the PCT Article 19 amendments. Applicant may submit that subject matter in a preliminary 
amendment filed under section 1.121. In many cases, filing an amendment under section 1.121 is preferable since 
grammatical or idiomatic errors may be corrected. " 1147 O.G. 29-40, at 36. 
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a. [ ] are transmitted herewith. 

b. [ ] have been transmitted 

i. [ ] by the International Bureau. 

Date of mailing of the amendment (from form PCT/IB/308): 

ii. [ ] by applicant on . 

Date 

c. [X] have not been transmitted as 

i. [X] applicant chose not to make amendments under PCT Article 19. 
Date of mailing of Search Report (from form PCT/ISA/210): 

ii. [ ] the time limit for the submission of amendments has not yet expired. 

The amendments or a statement that amendments have not been 
made will be transmitted before the expiration of the time limit under 
PCT Rule 46.1. 

[ X ] A translation of the amendments to the claims under PCT Article 19 (38 U.S.C. 
371(c)(3)): 

a. [ ] is transmitted herewith. 

b. [ ] is not required as the amendments were made in the English language. 

c. [X] has not been transmitted for reasons indicated at point 5(c) above. 

[X] A copy of the international examination report (PCT/IPEA/409) 
[X] is transmitted herewith. 

[ ] is not required as the application was filed with the United States Receiving 
Office. 

[ X ] Annex(es) to the international preliminary examination report 

a. [ X ] is/are transmitted herewith. 

b. [ ] is/are not required as the application was filed with the United States 

Receiving Office. 

[ X ] A translation of the annexes to the international preliminary examination report 

a. [ X ] is transmitted herewith. 

b. [ ] is not required as the annexes are in the English language. 

[X] An oath or declaration of the inventor (35 U.S.C. 371(c)(4)) complying with 35 
U.S.C. 115 

a. [ ] was previously submitted by applicant on 

Date 

b. [ ] is submitted herewith, and such oath or declaration 

i. [ ] is attached to the application. 

ii. [] identifies the application and any amendments under PCT Article 19 

that were transmitted as stated in points 3(b) or 3(c) and 5(b); and 
states that they were reviewed by the inventor as required by 37 
C.F.R. 1.70. 

iii. [ X ] will follow. 
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Other document(s) or information included: 

11. [X] An International Search Report (PCT/IS A/2 1 0) or Declaration under PCT Article 

17(2)(a): 

a. [ ] is transmitted herewith. 

b. [ X ] has been transmitted by the International Bureau. 

Date of mailing (from form PCT/TB/308): 3/16/00 

c. [ ] is not required, as the application was searched by the United States 

International Searching Authority. 

d. [ ] will be transmitted promptly upon request. 

e. [ ] has been submitted by applicant on . 

Date 

12. [X] An Information Disclosure Statement under 37 C.F.R. 1.97 and 1.98: 

a. [ X ] is transmitted herewith. 

Also transmitted herewith is/are: 

[ X ] Form PTO-1449 (PTO/SB/08A and 08B). 

[ X ] Copies of citations listed. 

b. [ ] will be transmitted within THREE MONTHS of the date of submission of 

requirements under 35 U.S.C. 371(c). 

c. [ ] was previously submitted by applicant on . 

Date 

13. [ ] An assignment document is transmitted herewith for recording. 

A separate [ ] "COVER SHEET FOR ASSIGNMENT (DOCUMENT) ACCOMPANYING 
NEW PATENT APPLICATION" or [ ] FORM PTO 1595 is also attached. 



[X] Additional documents: 

a. [ ] Copy of request (PCT/RO/101) 

b. [ X ] International Publication No WO00/14741 

i. [X ] Specification, claims and drawing 

ii. [ ] Front page only 

c. [k] Preliminary amendment (37 C.F.R. § 1.121) 

d. [X] Other 



Form PCT/TB/308 



Form PCT/TR/304 



Form PCT/TB/301 



FnrmPCT/m/337. 



12 Sheets of Formal Drawings 



[X] The above checked items are being transmitted 

a. [X] before 30 months from any claimed priority date. 

b. [ ] after 30 months. 
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16. [ ] Certain requirements under 35 U.S.C. 371 were previously submitted by the 
applicant on , namely: 



AUTHORIZATION TO CHARGE ADDITIONAL FEES 

WARNING: Accurately count claims, especially multiple dependent claims, to avoid unexpected high charges if extra 
claims are authorized. 

NOTE: "A written request may be submitted in an application that is an authorization to treat any concurrent or future 
reply, requiring a petition for an extension of time under this paragraph for its timely submission, as 
incorporating a petition for extension of time for the appropriate length of time. An authorization to charge all 
required fees, fees under § 1.17, or all required extension of time fees will be treated as a constructive petition for 
an extension of time in any concurrent or future reply requiring a petition for an extension of time under this 
paragraph for its timely submission. Submission of the fee set forth in §1.1 7(a) will also be treated as a 
constructive petition for an extension of time in any concurrent reply requiring a petition for an extension of time 
under this paragraph for its timely submission. " 37 C.F.R. § 1.136(a)(3). 

NOTE: "Amounts of twenty-five dollars or less will not be returned unless specifically requested within a reasonable 

time, nor will the payer be notified of such amounts; amounts over twenty-five dollars may be returned by check 
or, if requested, by credit to a deposit account. " 37 C.F.R. § 1.26(a). 

[X] The Commissioner is hereby authorized to charge the following additional fees that 
may be required by this paper and during the entire pendency of this application to 
Account No. 04-1105. 

[X] 37 C.F.R. 1 .492(a)(1), (2), (3), and (4) (filing fees) 

WARNING: Because failure to pay the national fee within 30 months without extension (37 C.F.R. § 1.495(b)(2)) 

results in abandonment of the application, it would be best to always check the above box. 

[X] 37 C.F.R. 1 .492(b), (c) and (d) (presentation of extra claims) 

NOTE: Because additional fees for excess or multiple dependent claims not paid on filing or on later presentation must 
only be paid or these claims cancelled by amendment prior to the expiration of the time period set for response by 
the PTO in any notice of fee deficiency (37 C.F.R. § 1.492(d)), it might be best not to authorize the PTO to charge 
additional claim fees, except possible when dealing with amendments after final action. 

[X] 37 C.F.R. 1.17 (application processing fees) 
[X] 37 C.F.R. 1.17(a)(l)-(5)(extension fees pursuant to § 1.136(a). 
[ ] 37 C.F.R. 1.18 (issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. 1.311(b)) 

NOTE: Where an authorization to charge the issue fee to a deposit account has been filed before the mailing of a Notice 
of Allowance, the issue fee will be automatically charged to the deposit account at the time of mailing the notice 
of allowance. 37 C.F.R. § 1.311(b). 

NOTE: 3 7 C.F.R. 1.28(b) requires "Notification of any change in loss of entitlement to small entity status must be filed in 
the application . . . prior to paying, or at the time of paying . . . issue fee. " From the wording of 37 C.F.R. § 
1.28(b): (a) notification of change of status must be made even if the fee is paid as "other than a small entity " and 
(b) no notification is required if the change is to another small entity. 
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[ ] 37 C.F.R. § 1 .492(e) and (f) (surcharge fees for filing the declaration and/or 
filing an English translation of an International Application later than 30 
months after the priority date). 




SIGNATURE OF PRACTITIONER 



Reg. No.: 27026 



Tel. No.: (617)523-3400 
Customer No.: 21874 



David G Crmlin 



(type or print name of practitioner) 

Dike, Bronstein, Roberts & Cushman 
Intellectual Property Practice Group 
EDWARDS & ANGELL, LLP 

1 30 Water Strret 

P.O. Address 

Boston MA 071QQ 
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Attorney Docket No. 55684(551) 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

APPLICANT: Masahiro Shioi, et al 

U.S.S.N.: Not Yet Assigned GROUP: Not Yet Assigned 

FILED: Filed Herewith 

FOR: METHOD AND APPARATUS FOR MANAGING MULTIMEDIA FILE 

Box Patent Application 

Assistant Commissioner for Patents 

Washington, D.C. 20231 



CERTIFICATE OF MATTING 

I hereby certify that this paper (along with any paper referred to as being attached or 
enclosed) is being deposited with the United States Postal Service, in an envelope as 
"Express Mail Post Office Addressee" Mailing Label Number EL730721527US addressed 
to the Commission of Patents and Trademarks, Washington, D.C. 20231 on March 8, 
2001. 




PR ELIMINARY AMENDMENT 

Sir: 

Please amend the subject application without prejudice as follows, and before 
calculating the filing fee therefor: 
TN THE CLATMS 

Cancel claims 1-15 without prejudice. 

Add new claims 16 through 34 as follows: 



Masahiro Shioi, et al 
U.S.S.N. Not Yet Assigned 
Preliminary Amendment 
Page 2 

16. (New) A method of managing a multimedia file managing said 
multimedia file with index information, multimedia data of said multimedia file being 
able to be managed in each prescribed management unit, including the steps of: 

generating said index information including a source identifier expressing a 
source having one or more of said management units associated with said multimedia 
file as a title frame, positions of a leading frame and tail frame of said title frame in 
said source, and a position of a reference frame for decoding said leading frame; and 

recording said index information onto a recording medium, attaching said 
index information to said multimedia file. 

17. (New) The managing method for a multimedia file according to claim 16, 
wherein said step of generating index information includes a step of generating a 
plurality of pieces of index information and said recording step includes a step of 
recording said plurality of pieces of index information and information for specifying 
the number of said pieces of index information onto a recording medium, attaching 
said plurality of pieces of index information and said information for specifying the 
number of said pieces of index information to said multimedia file. 

18. (New) The managing method for a multimedia file according to claim 16, 
further including the steps of: 

causing a user to specify one or more of management units associated with 
said multimedia file as a title frame; and 

generating second index information in which a bit stream obtained by 



Masahiro Shioi, et al 
U.S.S.N. Not Yet Assigned 
Preliminary Amendment 
Page 3 

encoding a specified title frame is embedded, 

wherein said recording step including a step of recording said index 
information and said second index information onto a recording medium together 
with flags indicating kinds of said index information and said second index 
information, respectively, attaching said index information and said second index 
information to said multimedia file together with said flags indicating kinds of said 
index information and said second index information. 

19. (New) A managing method for a multimedia file managing said 
multimedia file with index information, multimedia data of said multimedia file being 
able to be managed in each prescribed management unit, including the steps of: 

causing a user to specify one or more of said management units associated 
with said multimedia file as a title frame; 

generating index information in which a bit stream obtained by encoding a 
specified title frame and encoding information indicating a system for the encoding 
are embedded; and 

recording said index information onto a recording medium, attaching said 
index information to said multimedia file. 

20. (New) The managing method for a multimedia file according to claim 19, 
wherein said prescribed management unit is a frame of an image. 



21. (New) The managing method for a multimedia file according to claim 19, 



Masahiro Shioi, et al 
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wherein 

said step of generating index information includes a step of generating a 
plurality of pieces of index information and 

said recording step includes a step of recording said plurality of pieces of index 
information arid information for specifying the number of said pieces of index 
information onto a recording medium, attaching said plurality of pieces of index 
information and said information for specifying the number of said pieces of index 
information to said multimedia file. 

22. (New) A managing apparatus for a multimedia file managing said 
multimedia file with index information, multimedia data of said multimedia file being 
able to be managed in each prescribed management unit, including: 

an index information generating section generating index information including 
a source identifier expressing a source having one or more of said management units 
associated with said multimedia file as a title frame, positions of a leading frame and 
tail frame of said title frame in said source and a position of a reference frame for 
decoding said leading frame; and 

an index information attaching section recording said index information onto a 
recording medium, attaching said index information to said multimedia file. 

23. (New) The managing apparatus for a multimedia file according to claim 
22, wherein said multimedia file is an image file. 



Masahiro Shioi, et al 
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24. (New) The managing apparatus for a multimedia file according to claim 
23, wherein said prescribed management unit is a frame of an image. 

25. (New) The managing apparatus for a multimedia file according to claim 
22, wherein said index information generating section generates a plurality of pieces 
of index information and 

said index information attaching section records said plurality of pieces of 
index information and information for specifying the number of said pieces of index 
information onto a recording medium, attaching said plurality of pieces of index 
information pieces and said information for specifying the number of said index 
information pieces to said multimedia file. 

26. (New) The managing apparatus for a multimedia file according to claim 
22, wherein said index information generating section generates said index 
information including said source identifier specifying a title frame having one or 
more of said management units in said multimedia file, positions of a leading frame 
and tail frame of said title frame and a position of a reference frame for decoding said 
leading frame. 

27. (New) The managing apparatus for a multimedia file according to claim 
22, wherein said index information generating section generates said index 
information including said source identifier specifying a title frame having one or 
more of said management units in a second multimedia file different from said 



Masahiro Shioi, et al 
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multimedia file, positions of a leading frame and tail frame of said title frame and a 
position of a reference frame for decoding said leading frame. 

28. (New) The managing apparatus for a multimedia file according to claim 
22, further including: an index information specifying section causing a user to 
specify one or more of said management units associated with said multimedia file as 
a title frame, 

wherein 

said index information generating section generating second index information 
in which a bit stream obtained by encoding a specified title frame is embedded and 

said index information recording section recording said index information and 
said second index information onto a recording medium together with flags indicating 
kinds of said index information and said second index information, respectively, 
attaching said index information and said second index information to said 
multimedia file together with said flags indicating kinds of said index information and 
said second index information. 

29. (New) A managing apparatus for a multimedia file managing said 
multimedia file with index information, multimedia data of said multimedia file being 
able to be managed in each prescribed management unit, including: 

a frame specifying section forcing a user to specify and extract one or more of 
said management units associated with said multimedia file as a title frame; 
and 
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an index information attaching section recording said index information onto a 
recording medium, attaching said index information to said multimedia file. 

30. (New) The managing apparatus for a multimedia file according to claim 

29, wherein said multimedia file is an image file. 

3 1 . (New) The managing apparatus for a multimedia file according to claim 

30, wherein said prescribed management unit is a frame of an image. 

32. (New) The managing apparatus for a multimedia file according to claim 
29, wherein said index information generating section generates a plurality of pieces 
of index information and 

said index information attaching section records said plurality of pieces of 
index information and information for specifying the number of said pieces of index 
information onto a recording medium, attaching said plurality of pieces of index 
information pieces and said information for specifying the number of said index 
information pieces to said multimedia file. 

33. (New) A managing method for a multimedia file managing said 
multimedia file with index information, including the steps of: 

generating index information including a source identifier expressing a still 
picture file different from said multimedia file; and 

recording said index information onto a recording medium, attaching said 



Masahiro Shioi, et al 
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index information to said multimedia file. 

34. (New) A managing apparatus for a multimedia file managing said 
multimedia file with index information, including: 

an index information generating section generating index information including 
a source identifier expressing a file different from said multimedia file; and 

an index information attaching section recording said index information onto a 
recording medium, attaching said index information to said multimedia file. 

P R TVT A R K S 

Claims 1-15 have been cancelled without prejudice, and new claims 16 
through 34 have been added. The relationships between the new claims and the 
former claims (see "Annex to International Preliminary Examination Report enclosed 
herewith) is as follows: 

(1) Claim 16 is the former claim 1. 

(2) Claim 17 is the former claim 4 dependent from former claim 1. 

(3) Claim 18 is the former dependent claim 5. 

(4) Claim 19 is the former claim 2. 

(5) Claim 20 is the former claim 3. 

(6) Claim 2 1 is the former claim 4 dependent from former claim 2. 

(7) Claims 22 is the former claim 6. 

(8) Claim 23 is the former claim 8 dependent from former claim 6. 
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(9) Claim 24 is the former claim 9 dependent from former claims 6 and 8. 

(10) Claim 25 is the former claim 10 dependent from former claim 6. 

(11) Claims 26 to 28 are the former claims 1 1 to 13, respectively. 

(12) Claim 29 is the former claim 7. 

(13) Claim 30 is the former claim 8 dependent from former claim 7. 

(14) Claim 31 is the former claim 9 dependent from former claims 7 and 8. 

(15) Claim 32 is the former claim 10 dependent from former claim 7. 

(16) Claims 33 and 34 are the former independent claims 14 and 15, respectively. 

It is respectfully requested that the references cited in connection with the 
parent application, USSN 09/096,989, filed June 12, 1998, be considered in 
connection with the present application. 

The specification was amended to indicate the continuing status of the present 
case and identify the parent application. 

It is respectfully submitted that the subject application is in condition for 
immediate allowance. Early and favorable action is requested. 

Applicants believe that additional fees are not required for consideration of the 
within Preliminary Amendment. However, if for any reason a fee is required, a fee paid 
is inadequate or credit is owed for any excess fee paid, you are hereby authorized and 
requested to charge Deposit Account No. 04-1105. 
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The undersigned respectfully requests the Examiner to contact the undersigned 



at the phone /fax/ email address given below, should it appear that the undersigned can 



do anytiiing to advance the prosecution of this application. 



Respectfully submitted, 



Date: March 8, 2001 




David G. Conlin 
(Reg. No. 27026) 
Dike, Bronstein, Roberts 8s Cushman 
Intellectual Property Practice Group 
EDWARDS & ANGELL, LLP 
130 Water Street 
Boston, MA 02109 
(617) 523-3400 Phone 
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SPECIFICATION 



Method and Apparatus for Managing Multimedia File 



5 Technical Field 

The present invention relates to management of a multimedia file, 
and particularly, to a method and apparatus for managing a multimedia 
file by Unking index information to the multimedia file in order to identify 
contents of the multimedia file with ease. 

10 

Background Art 

With the advent of the advanced semiconductor technology, 
sophisticated image processing technology, growth in high speed network, 
and further, widespread use of digital video cameras, digital still cameras 

15 and the digital sound recording/reproducing technology in recent years, the 
number of multimedia files requiring management has been increasing. 
In a case where many of multimedia files are to be managed, a need for 
some contrivance arises in order to specify contents of a multimedia file. 
The most popular way adopted for the purpose is to give a title that 

20 expresses contents of the multimedia file to the multimedia file itself. For 
example, a title "Birthday Party for My Wife in '95" is the case. 

Furthermore, a case exists such that a comment on a file can be 
attached to the file as an attribute or additional information thereof in 
some of operating systems (OS) for a personal computer. On such an 

25 operating system, information expressing contents of a file can be further 
attached to the file attribute or additional information in addition to a title 
of the file. Generally speaking, while there is a limitation on a length of a 
title, a length of information which can be attached to a file as an attribute 
thereof is longer than the hmitation; therefore, more detailed information 

30 can be provided. 

When information that expresses contents of a multimedia file as a 
title or an attribute is attached to the multimedia, a person responsible for 
Unking the title or information would be able to identify a desired file 
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among many of files. Others, however, will have difficulty in correctly 
knowing contents of a multimedia file based solely on a title or information 
attached to the multimedia file. Especially, it will be more difficult to find 
a multimedia file with desired contents among many files based solely on a 
5 title or such information thereof. Consequently, it has been a common 
practice to investigate contents of multimedia files one by one to identify 
the contents thereof to find out a desired multimedia file. 

A technique to solve such a problem is disclosed in Japanese Patent 
Laying-Open No. 6-195880(1994). The technique disclosed in the 

10 publication relates to an image file including, for example, an intra-coded 
picture (referred to as I picture) as defined in MPEG (Moving Picture 
coding Experts Group). An I picture is obtained by encoding one frame of 
an image to be encoded, regarding it as a still picture. That is, the I 
picture is a frame image encoded without using interframe prediction. 

15 Hence, the original frame can be decoded without referring to another 
picture. 

According to this prior art technique, one or a plurality of I frames 
(frame constituted of an I picture) in each image file are selected in advance, 
selected encoded data itself or position information of the selected encoded 

20 data in the image file is extracted and the data or the information is linked 
to the head end of the image file as a management heading. Thus, frames 
expressed with encoded datas are restored based on management headings 
at the heads of many image files and displayed into a list. 

Fig. 1 shows a file structure that was adopted in the prior art. 

25 Referring to Fig. 1, an image file 30 includes: a management heading 32 
stored on a recording medium such as a hard disk; and a moving picture 
data 34 consisting of I frames cyclically placed and a plurality of P frames 
inserted between I frames. The P frame is a frame constituted of a P 
picture (predictive-coded picture) obtained by encoding based on prediction 

30 from the previous I frame of the frame of interest. The management 

heading 32 contains information specifying contents of a selected I frame 
itself or a position of the selected I frame. 

Fig. 2 shows a system configuration for outputting a prior art image 
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file 30. In this system, position information of a selected I frame is stored 
in the management heading 32. Referring to Fig. 2, a prior art system 40 
includes: a title frame specifying section 42 for specifying one or more I 
frames representing contents of each of image files; a title frame position 
5 analyzing section 44 for analyzing a position of the one or more I frames in 
each of image files; and a title frame information generating section 46 for 
attaching information on the position of the one or more I frames analyzed 
by the title frame position analyzing section 44 to the head of the each of 
image files as a management heading 32. Note that the title frame 

10 specifying section 42 specifies a default value (for example, an I frame at 

the leading place) as a title frame when no title frame is specified by a user. 

In each of image files, some of I frames arranged cyclically are 
inevitably contained. Data in an I frame can be presented to a user in the 
form which the user can see without the help of data of another frame, 

15 similar to a still picture. Hence, any one can see an image of an I frame 
specified by the heading of an image file to identify contents of the image 
file and determine whether or not the image file is a desired one. 

The technique shown in the publication of the above described 
Japanese Patent Laying-Open No. 6-195880(1994) has some of problems 

20 remaining to be solved. First of all, in this prior art technique, an I frame 
is limitedly selectable for a management heading. Even if a desired image 
is intended to be a heading image, the desired image cannot be a heading 
image when it is not of an I frame. Hence, in the prior art, a user cannot 
specify an arbitrarily selected frame as a heading image. 

25 Furthermore, in a case where there is a file that expresses 

satisfactorily contents of a multimedia file as a different file from the 
contents of the multimedia file, a problem arises in that the different file 
cannot be specified as a title frame for a heading. In such a case, the 
different file can be desirably specified as a heading of the multimedia 

30 information file. 

Besides, in a case where a title frame is a picture, it is more 
preferably used because of directly expressing the contents of a file if not 
only a still picture but also any moving picture can be specified. 



The invention has been made in order to solve the above described 
problems and it is accordingly an object of the invention to provide a 
method and apparatus for managing a multimedia information file capable 
of specifying any frame as a title frame for use in a heading. 
5 It is another object of the invention to provide a method and 

apparatus for managing a multimedia information file capable of specifying 
not only a still picture but also a moving picture as a heading image. 

It is still another object of the invention to provide a method and 
apparatus for managing a multimedia information file capable of specifying 
10 any frame of any file including a file other than a multimedia information 
file to be processed as a heading image. 

It is yet another object of the present invention to provide a method 
and apparatus for managing a multimedia information file capable of 
specifying not only a still picture but also a moving picture including a file 
15 other than a multimedia information file to be processed as a heading 
image. 

Disclosure of the Invention 

According to an aspect of the present invention, a managing method 

20 for a multimedia file includes the steps of: generating index information 
including a source identifier expressing a source having one or more 
management units associated with a multimedia file as a title frame, 
positions of a leading frame and tail frame of the title frame in the source, 
and a position of a reference frame for decoding the leading frame; and 

25 recording said index information onto a recording medium attaching said 
index information to said multimedia file. 

Since index information includes positions of not only a leading 
frame but also a tail end of a title frame, a series of multimedia data 
including a plurality of management units can be used as the title frame. 

30 In this case, contents of a multimedia file can be identified with ease as 
compared with a case where only one frame having a specified 
characteristic is used as the title frame. 

According to another aspect of the present invention, a managing 
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method for a multimedia file includes: the steps of; generating index 
information in which a bit stream obtained by encoding a specified title 
frame and encoding information indicating a system for the encoding are 
embedded; and recording the index information onto a recording medium, 
5 attaching the index information to the multimedia file. 

A bit stream obtained by encoding a specified title frame is embedded 
in a title frame and attached to a multimedia frame. Hence, even if data 
of an original title frame is modified or deleted, a title frame can be 
correctly presented and contents of the file can be identified with ease. 

10 This procedure may be combined with the first managing method for a 

multimedia file described above. In that case, a flag indicating a kind of 
information contained in index information is set to the index information. 

The step of generating index information preferably includes a step 
of generating a plurality of pieces of index information and the recording 

15 step includes a step of recording the plurality of pieces of index information 
and information for specifying the number of the pieces of index 
information onto a recording medium, attaching the plurality of pieces of 
index information and the information for specifying the number of the 
plurality of pieces of the index information to the multimedia file. 

20 Since a plurality of pieces of index information can be linked to a 

multimedia file, contents of the file can be expressed in a variety of ways, 
thereby enabling determination of contents of the multimedia file with 
more ease. 

According to still another aspect of the present invention, a 
25 managing apparatus for a multimedia file includes: an index information 
generating section generating index information including a source 
identifier expressing a source having one or more management units 
associated with the multimedia file as a title frame, positions of a leading 
frame and tail frame of the title frame in the source and a position of a 
30 reference frame for decoding the leading frame; and an index information 
finking section recording the index information onto a recording medium, 
attaching the index information to the multimedia file. 
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Since index information includes positions of not only a leading 
frame but also a tail end of a title frame, a series of multimedia data 
including a plurality of management units can be used as a title frame. In 
this case, contents of the multimedia file can be identified with ease as 
5 compared with a case where only one frame having a specified 
characteristic is used as the title frame. 

According to yet another aspect of the present invention, a managing 
apparatus for a multimedia file includes: a frame specifying section; an 
index information generating section generating index information in 
10 which a bit stream obtained by encoding an extracted title frame and 

encoding information indicating a system for the encoding are embedded; 
and an index information attaching section recording the index information 
onto a recording medium, attaching the index information to the 
multimedia file.. 

15 A bit stream obtained by encoding a specified title frame is embedded 

in a title frame and attached to a multimedia file. Hence, even if data of 
an original title frame is modified or deleted, the title frame can be 
correctly presented and contents of the file can be identified with ease. 
This procedure may be combined with the first managing apparatus for a 

20 multimedia file described above. In that case, a flag indicating a kind of 
information contained in index information is set to the index information. 

It is preferable that the index information generating section 
generates a plurality of pieces of index information and the index 
information attaching section records a plurality of pieces of index 

25 information and information for specifying the number of the index 

information onto a recording medium, attaching the plurality of pieces of 
index information and the information for specifying the number of the 
index information pieces to a multimedia file. 

Since a plurality of pieces of index information are attached to a 

30 multimedia file, contents of the file can be expressed in a variety of ways, 
thereby enabling determination of contents of the multimedia file with 
more ease. 
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Brief Description of the Drawings 

Fig. 1 shows an example structure of an image file in the prior art; 

Fig. 2 is a diagram showing an configuration for outputting an image 
file in the prior art; 

5 Fig. 3 is a block diagram of an apparatus of a first embodiment of the 

present invention; 

Fig. 4 is a representation showing a format of a title frame specifying 
portion in the first embodiment of the invention of the present application; 
Fig. 5 is a representation schematically showing a process of 
10 extracting a title image from a multimedia information file when an I frame 
is used as a still picture title; 

Fig. 6 schematically shows a process of extracting a title image from 
a multimedia information file when a P frame is used as a still picture title; 
Fig. 7 schematically shows a process of extracting a title image from 
15 a multimedia information file when a P frame included in a different file is 
used as a still picture title; 

Fig. 8 schematically shows a process of extracting a title image from 
a multimedia information file when a plurality of frames having an I frame 
as a leading frame are used as a moving picture title; 
20 Fig. 9 schematically shows a process of extracting a title image from 

a multimedia information file when a plurality of frames having a P frame 
as a leading frame are used as a moving picture title; 

Fig. 10 schematically shows a process of extracting a title image from 
a multimedia information file when a plurality of frames having a P frame 
25 as a leading frame, included in a different file, are used as a moving picture 
title; 

Fig. 11 schematically shows a process of extracting a title image from 
a multimedia information file when still picture data, in a different file, is 
to be a still picture title; 
30 Fig. 12 schematically shows a process of selecting a file based on a 

file name field; 

Fig. 13 schematically shows a process of determining a title frame 
position based on a variety of pieces of information in a header; 
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Fig. 14 is a flow chart showing a process for preparing title frame 
information when recording a moving picture; 

Fig. 15 is a flow chart showing a process for preparing title frame 
information for a moving picture recorded already; 
5 Fig. 16 is a flow chart showing a process for decoding and displaying 

a title frame; 

Fig. 17 is a block diagram of an apparatus of a second embodiment of 
the invention of the present application; 

Fig. 18 schematically shows a title frame image used in the second 
10 embodiment; 

Fig. 19 is a representation showing an example structure of a 
multimedia information file and a process of extracting a title image based 
on header information; and 

Fig. 20 is a more detailed representation showing a header of the 
15 multimedia information file shown in Fig. 19. 

Best Modes for Carrying Out the Invention 

In the following descriptions, the term "multimedia data" means any 
data including a character, a picture, voice, sound, a graphic, a video image 

20 and others. Furthermore, in the following descriptions as well, when the 
term "to input NULL into a field" is used, the term means that an input 
value into the field is not specifically defined and at the time, a NULL code 
is stored into the field. As a NULL code, either all zeros in a binary 
notation as a general practice or alternatively a specified value defined in 

25 advance of operation may be used. 

While the following description will be given mainly of an image file, 
the invention is applicable to not only an image file, but also general 
multimedia data such as including voice and a graphic and entire data 
having a unit manageable in a general way such as a frame, GOP, a macro 

30 block and a slice. 

The term "I frame" means a frame constituted of an I picture (Intra- 
coded picture) obtained by encoding one frame of an image to be encoded, 
regarding the one frame as a still picture in MPEG, as described above. 
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The term "P frame" means a frame constituted of a P picture obtained by 
encoding based on prediction from one frame at a previous time of the 
frame of interest. The term "B frame" means a frame constituted of a B 
picture (bidirectionally predictive picture) obtained by encoding through 
5 interpolation on I frames or P frames at subsequent and previous times of 
the frame of interest. The abbreviation "GOP" (Group of pictures) means a 
group of images including an I frame, a P frame and a B frame combined, 
described above. 

The term "macro block" (MB) generally means a matrix of 16 x 16 

10 pixels. A macro block is used in a temporal information compression 
(interframe prediction) by motion compensation. 

The term "slice" is a band of a macro block of an arbitrary length. 
Note that one slice cannot extend over two or more pictures. 

Referring Fig. 3, an image managing apparatus 50 according to the 

15 first embodiment of the present invention is an apparatus for outputting a 
multimedia information file with a management heading attached using 
multimedia data to be processed as an input. The image managing 
apparatus 50 includes: an extraction file determining section 58 selecting a 
file including an image as a title frame (a heading image) according to an 

20 input of a user; a reproducing/displaying section 56 reproducing/displaying 
contents of a file determined by the extraction file determining section 58; a 
title frame specifying section 54 specifying a part that is to be a title frame 
in an image file displayed by the reproducing/displaying section 56 
according to a user's operation; a default specifying section 52 spectfying a 

25 title frame according to a default method registered in advance of 

operation; a default /specification switching section 60 selecting an output 
of the title frame specifying section 54 when an input from a user exists, or 
an output of the default specifying section 52 when no input from a user 
exists; a title frame analyzing/generating section 62 analyzing information 

30 outputted from the default/specification switching section 60 to output a file 
name containing a specified title frame, a position of an I frame in the 
specified file necessary for correctly restoring a frame at a start position of 
the specified title frame in the specified file, and a start position and a 
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start position and a finish position of the specified title frame; and a title 
frame information attaching section 64 attaching a title file name, a 
position of a title reference frame, start and finish positions of a title frame 
outputted by the title frame analyzing/generating section 62 to multimedia 
5 data as a management heading. Note that when a user specifies no 
extraction file to be obtained by use of the extraction file determining 
section 58, multimedia data itself to be processed is specified as an 
extraction file as the case of default. 

The title frame analyzing/generating section 62 includes a title file 

10 name storing section 70 analyzing information outputted from the 

default/specification switching section 60 to extract and store a file name 
containing a specified title name, and further output the file name to the 
title frame information attaching section 64; a title frame position storing 
section 72 analyzing information outputted from the default/specification 

15 switching section 60 to determine and store a position of an I frame in a 

specified file necessary for correctly restoring a frame at a start position of 
a specified frame in the specified file and further output the position of an I 
frame to the title frame information attaching section 64; and a title frame 
position storing section 74 analyzing information outputted from the 

20 default/specification switching section 60 to determine start and finish 
positions of a specified title frame in a specified file and output the 
determination results to the title frame information attaching section 64. 
What the title file name storing section 70 extracts is not limited to a file 
name of a local file, but may be any of information for use in specifying a 

25 source from which a title image is extracted such as a file identifier, a file 
number, a leading end address of a file, a file name containing a network 
path, all of which are in a system; and in addition an IP address on a 
network connected using TCP/IP (Transfer Control Protocol/Internet 
Protocol), and URL (Uniform Resource Locator) on the Internet, singly or in 

30 combination. 

Referring to Fig. 4, a title frame specifying portion linked by the 
image managing section 50 includes: a title file name specifying a file 
containing a title frame; a title reference frame position specifying a 
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position of an I frame, necessary for correctly restoring a title image, in a 
file specified by a title name; a position of a title leading frame indicating a 
position of a leading frame, of one or more frames constituting a title image, 
in a file specified by a title name; and likewise, a position of a title tail 
5 frame indicating the position of a tail frame. Note that while in this 
embodiment, the title frame specifying portion is stored in a header- 
attached to the leading end of multimedia data, the output is not only 
located at the leading end of multimedia data but may also be disposed at 
any location thereof. 

10 The term "title file name" is a value extracted and outputted by the 

title file name storing section 70. In a case where a NULL is stored here, 
the file of interest can be specified as a default. 

A position of a title reference frame is a value extracted and 
outputted by the title reference frame position storing section 72. The title 

15 reference frame position is data indicating an offset position relative to the 
file leading end, of an I frame at which decoding is started, required for 
correctly restoring a title frame when the title frame is restored and 
displayed. If the leading frame of a title frame is an I frame, a title 
reference frame position coincides with the leading position of the title 

20 frame. If the leading frame of the title frame is not an I frame, the title 
reference frame position is a position of an I frame required for correctly 
decoding the title frame, that is a position of an I frame among I frames 
present ahead of the leading frame of the title frame, closest to the leading 
frame. 

25 A title leading frame position and a title tail frame position are data 

extracted and outputted by a title frame position storing section 74 and 
indicate positions of the leading frame and the tail frame, respectively, 
among one or more frames, serving as a title frame, in a file specified by a 
title name. Note that in this embodiment, a title frame position is an 

30 offset from a title leading frame position. The title tail frame position is 
an offset from the title leading frame position. Note that the above 
described frame positions can be expressed as differentials from an 
arbitrary position in a file as a reference. Furthermore, if physical 
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positions of frames on a medium on which a multimedia information file is 
finally recorded are known, the frame positions may be specified with the 
respective physical positions. 

In addition, the leading and tail end positions of a title are here 
5 specified using a frame position. However, a position of a title image may 
be specified using a unit larger than a frame, for example, a GOP in MPEG. 
Alternatively, a position of a title image may be specified using a unit 
smaller than a frame, for example, a slice or a macro block. By enabling 
specification of a title image with a unit larger than a frame, an 

10 information amount (region) necessary for specifying a title image is 
reduced and frames can be managed using a series of pictures to be 
subjected to special reproduction as a unit. Alternatively, by enabling 
specification of a title image using a unit small than a frame, a title image 
smaller than a display size can be specified. 

15 According to the invention, by specifying a title image using both of a 

leading frame position and a tail frame position as described above, not 
only a still picture but also a moving picture can be used as a title image. 

The image managing apparatus 50 shown in Fig. 3 operates as 
follows. First, multimedia data is inputted to this apparatus. A user 

20 inputs which file of an image is to be specified as a title image, using the 

extraction file determining section 58. The reproducing/displaying section 
56 reproduces/displays the specified file according to the file information 
outputted by the extraction file determining section 58. The user specifies 
which part of a displayed image is used as a title image, using the title 

25 frame specifying section 54. This information is provided to the 
default/specification switching section 60. 

The default/specification switching section 60 selectively provides an 
output of the title frame specifying section 54 to the title frame 
analyzing/generating section 62 when a user's input by the title frame 

30 specifying section 54 exists, while selectively providing an output of the 
default specifying section 52 thereto when no user's input exists. 

The title file name storing section 70 extracts a title file name from 
input information and stores and outputs the title file name to the title 
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frame information attaching section 64. The title reference frame position 
storing section 72 extracts a title reference frame position from input 
information and stores and outputs the position to the title frame 
information attaching section 64. The title frame position storing section 
5 74 extracts a title frame position (a start frame position and a tail frame 
position) from input information and stores and outputs the position to the 
title frame information attaching section 64. 

The title frame information attaching section 64 prepares a 
management heading according to a title frame specifying portion format 

10 shown in Fig. 4 based on the title file name, the title reference frame 
position and the title frame position outputted from the title file name 
storing section 70, the title reference frame position storing section 72 and 
the title frame position storing section 74, respectively, to attach the 
management heading to the leading end of input multimedia data as a 

15 header and output the management heading in a multimedia information 
file. 

Next, description will be given of a format of a multimedia 
information file having the above described title frame specifying portion 
and data handling when a title image is displayed based on contents of the 
20 file. 

Fig. 5 shows contents of a multimedia information file when one I 
frame contained in inputted multimedia data is used as a title frame. 
Referring to Fig. 5, the multimedia information file 80 includes a title 
frame specifying portion 82 as image heading information. 

25 The title frame specifying portion 82 includes: a file name 84; a title 

reference frame position 86; a title leading frame position 88; and a title 
tail frame position 90. Contents of those constituents are described above. 
In the example shown in Fig. 5, a file name of the multimedia information 
file 80 itself is stored in the file name 84. Information indicating a 

30 position of an I frame 92, which is the fifth frame, is stored in the title 

reference frame position 86. NULLs are stored in the title leading frame 
position 88 and the title tail frame position 90. 

In this case, a still picture constituted of the I frame 92 in the 
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multimedia information file 80 is specified as a title image. Note that 
when NULL is stored in the file name 84, it may be construed that a file of 
interest is specified. When NULL is stored in the title leading frame 
position 88, it is construed that the title leading frame position is the same 
5 as the title reference frame position. Furthermore, since data (NULL) 

indicating being the same as the title leading frame position -88 is stored in 
the title tail frame position 90, it is construed that a title image is a still 
picture. 

Fig. 6 shows an example in which a title image is one non-I frame (P 
10 frame 96) of the multimedia information file 80 itself. A file name of the 
multimedia information file 80 is stored in the file name 84. A position of 
the last I frame 94 among I frames preceding the P frame 96 is stored in 
the title reference frame position 86. An offset from the I frame 94 to the P 
frame 96 is stored in the title leading frame position 88. In the example of 
15 Fig. 6, the title reference frame position 86 stores "5" and the title leading 
frame position 88 stores "2". Since a title image is a still picture, NULL is 
stored in the title tail frame position 90. Note that the same data as the 
title leading frame position 88 may be stored in the title tail frame position 
90. 

20 Fig. 7 shows a case where a title frame of the multimedia 

information file 80 is a P frame 104 included in a multimedia information 
file 100. In this example, the file name 84 stores a file name of the 
multimedia information file 100. The title reference frame position 86 
stores a position of an I frame 102 in the multimedia information file 100. 

25 The title leading frame position 88 stores an offset of the P frame 104 from 
the I frame 102. The title tail frame position 90 stores NULL. 

Fig. 8 shows a case where a moving picture 1 10 constituted of a 
plurality of frames starting at the I frame 94 and ending at a P frame 112 
of the multimedia information file 80 itself is used as a title image. The 

30 file name 84 stores a file name of the multimedia information file 80 itself. 
The title reference frame position 86 stores a position of the I frame 94. 
Since the title leading frame is the I frame 94, NULL is stored in the title 
leading frame position 88. A position of the P frame 1 12 (an offset from 



- 14- 



the I frame 94) is stored in the title tail frame position 90. In this example, 
"3" is stored in the title tail frame position 90. 

Fig. 9 shows a case where a moving picture 1 10 constituted of a 
plurality of frames starting at the P frame 96 and ending at the P frame 
5 1 12 of the multimedia information file 80 itself is used as a title image. 
The file name 84 stores a file name of the multimedia information file 80 
itself. The title reference frame position 86 stores a position of the I frame 
94, which is the last one among I frames preceding the P frame 96. The 
title leading frame position 88 stores an offset from the I frame 94 to the P 

10 frame 96. In the example shown in Fig. 9, "1" is stored in the title leading 
frame position 88. The title tail frame position 90 stores an offset from a 
position of the P frame 96 to a position of the P frame 112. In the example 
shown in Fig. 9, "2" is stored in the title tail frame position 90. 

Fig. 10 shows a case where a moving picture 128 constituted of two 

15 frames, P frame 124 and P frame 126, included in a multimedia 

information file 120 different from the multimedia information file 80 is a 
title image of the multimedia information file 80. The file name 84 stores 
a file name of a multimedia information file 120. The title reference frame 
position 86 stores a position of an I frame 122, which is the last one among 

20 I frames preceding the P frame 124 in the multimedia information file 120. 
The title leading frame position 88 stores an offset from the I frame 122 to 
the P frame 124, "2" in the example shown in Fig. 10. The title tail frame 
position 90 stores an offset from the P frame 124 to the P frame 126, "1" in 
the example shown in Fig 10. 

25 Fig. 11 shows a case where a file 130 different from the multimedia 

information file 80 is a title image. It is assumed that the file 130 is a still 
picture file. The file name 84 stores a file name of the file 130. The tile 
reference frame position 86, the title leading frame position 88 and the title 
tail frame position 90 all stores NULL. 

30 In the example shown in Fig. 11, while the file 130 is a still picture 

file, it may be a moving picture file. In a case where information as in Fig. 
11 is stored in from the file name 84 to the title tail frame position 90, all of 
the moving picture from the first to the last frames are specified as a title 
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image. 

Description will be given in the following, of a method in which a 
title image is restored based on a title frame specifying portion of the above 
described format. Since if an image to be finally restored is determined as 
5 a still picture or a moving picture, a method for reproducing/restoring the 
picture is obvious for a person skilled in the art, detailed description 
thereof is not given here for clarity reason. 

Referring to Fig. 12, it is determined whether or not contents of the 
file name 84 is NULL. If the file name 84 is NULL, a file of interest is 

10 specified (142), else a different file is specified (144). Needless to say, 

when a file name of the file of interest is stored in the file name 84, the file 
of interest is also specified. 

Referring to Fig. 13, it is next determined whether or not the title 
reference frame position 86 is NULL. If the title reference frame position 

15 86 is NULL, it is construed that all of a file specified by the file name 84 is 
specified (152), else it is determined whether or not contents of the title 
leading frame position 88 are NULL. 

In a case where the contents of the title leading frame position 88 is 
NULL, it indicates that the title leading frame position 88 is the same as 

20 the title reference frame position 86. That is, it means that the frame of 
the title leading frame position 88 is an I frame. In this case, it is next 
determined whether or not contents of the title tail frame position 90 is 
NULL. If the contents of the title tail frame position 90 are NULL, it is 
construed that the title leading frame position 88 and the title tail frame 

25 position 90 are the same. One frame of I frames specified by the title 

reference frame location 86 or a still picture thereof is specified as a title 
image. In a case where contents of the title tail frame position 90 are not 
NULL, a moving picture with an I frame specified by the title reference 
frame position 86 as a leading frame and including the following frames the 

30 last one of which is specified by the title tail frame position 90 is specified 
as a title image. 

In a case where contents of the title leading frame position 88 are not 
NULL, it means that the title leading frame is not an I frame (is a non-I 
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frame). In this case as well, it is determined whether or not contents of 
the title tail frame position 90 are NULL. If the title tail frame position 90 
is NULL, it is construed that one frame of non-I frames specified by the 
title leading frame position 88 is specified as a title image (164), else, a 
5 moving picture with a non-I frame indicated by the title leading frame 

position 88 as a leading frame and including the following series of frames 
the last one of which is indicated by the title tail frame position 90 is 
specified as a title image. 

Note that in the above presented description, by storing NULL in a 

10 field, it is shown that there is no information in the field (the information is 
the same as that of another field). However, the present invention is not 
limited to such an implementation. For example, a flag indicating 
whether or not each field exists may be provided to a title frame specifying 
portion for the each field. In this case, if data to be stored in a region is 

15 NULL, a flag is set to a value indicating "nothing" and a corresponding 
region is designed not to be provided. By doing so, since no region in 
which a frame position is to be stored is required, a data storing region can 
be effectively utilized. 

Next, description will be given of a flow of process for preparing title 

20 frame information with the above described structure with reference to Figs. 
14 and 15. Fig. 14 is a flow of a process for preparing title frame 
information when a title frame is specified using a default value. 
Typically, this process is performed when an image is first prepared. 

In this example, it is assumed that one leading I frame of a file of 

25 interest is specified as a title frame due to reflection of a default value. 

When multimedia data is first recorded as an image, a system can be set 
such that one leading frame of a file of interest is automatically used as a 
title frame in this way. 

When recording gets started (step S10), information according to 

30 setting of default is stored in elements of a title frame specifying portion 
residing in a header portion of a multimedia information file. Herein, a 
name of the file of interest is stored in a title file name. Information 
indicating a position of a leading frame of the multimedia information file 
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is stored in a title reference frame position. Note that it is here assumed 
that the leading frame is an I frame at all times. Nulls are stored in the 
title leading frame position and the title tail frame position. By doing so, 
one frame (I frame) at the leading position of the file of interest 
5 automatically serves as a title frame of this multimedia information file. 

Referring to Fig. 15, when a user sets an arbitrary image as a title 
frame of a multimedia information file, a file including a title frame is 
selected in step S20. Herein, any of the multimedia files itself or a 
different file can be selected. It is assumed that when there is no input, 

10 the file of interest is selected as default. In a case where a selected file is a 
still picture file, though not shown, NULLs are stored at this time point in 
a title reference frame position, a title reference frame position, a title 
leading frame position and a title tail frame position of a title frame 
specifying portion, which terminates the process. 

15 Then, multimedia data in a selected multimedia information file is 

reproduced (step S22). During this reproduction, it is constantly managed 
whether or not a frame in display is an I frame and which frame is an I 
frame displayed at a previous time. In such a way, it is constantly 
determined whether or not a reproduction pause is instructed by a user 

20 during reproduction (step S24) and when an instruction of a reproduction 
pause is issued, the control goes to step S26. 

In step 26, an image in display is frozen. That is, an image 
displayed at that time point stops its motion and is presented like a still 
picture. Information on the frame in display is stored in the title reference 

25 frame position and the title leading frame position. At this time point, if 
the frame in display is an I frame, a position of the frame is stored in the 
title reference frame position and NULL is stored in the title leading frame 
position. If the frame in display is not an I frame, a position of an I frame 
(typically, the last I frame preceding the frame in display) required for 

30 displaying the frame in display is stored in the title reference frame 

position and an offset from the last I frame to a position of the frame in 
display is stored in the title leading frame position. 

Next, the apparatus awaits a user's operation (step S28). More 
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specifically, at this time, the user specifies restart of reproduction, or 
terminates specification of a title frame. 

In step S30, it is determined whether or not a user's specified restart 
of reproduction. If the operation specifies the restart of reproduction, 
5 reproduction of multimedia data is restarted in step S32 from the state at a 
time point at which the reproduction was stopped at a previous time. It is 
constantly monitored by the user whether or not a pause is specified during 
the reproduction (step S34) and if the pause is specified, the control goes to 
step S36. 

10 In step S36, an image currently in display is frozen again and an 

offset between a position of the frame in display and a position of a title 
leading frame is stored in the title tail frame position. 

Meanwhile, if it is determined that the user does not instruct restart 
of reproduction in step S30, it is further determined in step S38 whether or 

15 not a user's operation is one instructing termination of specification of a 
title frame. If the user does not instruct to terminate specifying of a title 
frame, the control returns to step S28 to repeat the above described process. 
If a user's operation is one instructing specification of a title frame, a value 
(NULL) indicating that the title tail frame position is the same as the title 

20 leading frame position is stored in the title tail frame position in step S40. 

According to the above described process, pieces of information of the 
title frame specifying portion are set. Title frame information prepared by 
the processing is provided to an image file. The title frame information 
may be attached to either the leading end or the tail end. Furthermore, it 

25 is also allowed that the title frame information is a title frame information 
file different from the image file and the title frame information file and the 
image file are linked to each other. In this case, a special rule may be 
provided between the image file and the title frame information file using a 
file identifier or the like. 

30 In this way, by attaching or relating title frame information of the 

image file to the image file, contents of the image file can be displayed so as 
to be easily understood. For example, by automatically 
reproducing/displaying title frame information provided to the image file at 
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the time point when a recording medium on which the image file is 
recorded is inserted into a reproducing apparatus, the user can 
immediately identify contents of the image file. Furthermore, display of 
the title frame is not automatically effected but may be started by a user's 
5 instruction. 

Referring to Fig. 16, decoding and displaying of a title 'frame are 
performed in the following way: When reproduction of a title frame is 
started, a file containing the title frame is read out according to the file 
name 84 (step S50). This file may be either a file of interest or a different 

10 file. Here, it is determined what a coding system of a read-out file is. 

Next, encoded data of an I frame indicated by the title reference 
frame position 86 is read out (step S52). The encoded data is decoded (step 
S54). Then, it is determined whether or not the decoded frame is after the 
frame indicated by the title reference frame position 86 in the order of 

15 position (step S56). If a determination result is "NO," encoded data in the 
next frame is read out (step S62), the control returns to step S54. By 
doing so, data are progressively read out up to the frame indicated by the 
title reference frame position 86. If a determination result in step S56 is 
"YES," decoded data is displayed (step S58). 

20 In succession, it is determined in step S60 whether or not a frame in 

display is a frame indicated by the title tail frame position 90. If a 
determination result is "NO," the control goes to step S64. Data in the 
next frame is read out in step S64 and successively decoded (step S66). 
Subsequent to this, the control returns to step S58 and thereafter, frames 

25 including a frame indicated by the title tail frame position 90 at the last 
place are sequentially reproduced/displayed. If a determination result in 
step S60 is "YES," the process is terminated. 

Note that though not shown, if a file specified by the file name 84 is 
a still picture file, it is found immediately when the file is read out (step 

30 S50), therefore, an image has only to be decoded and displayed. 

According to this embodiment, as described above, the following 
process can be effected such that title frame information is provided to a 
multimedia information file, and a still picture or a moving picture in 
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multimedia information thereof, or a still picture or a moving picture of a 
different file can be decoded/displayed as a title image expressing contents 
of the multimedia information file according to the title frame information. 
Hence, any user can understand contents of a file with ease. 
5 In the first embodiment described above, a still picture or a series of 

moving pictures can be specified as a title frame. It is convenient, however, 
that not only one still picture or a series of moving pictures, but also a 
plurality of still pictures or a plurality of moving picture sequences can be 
specified as a title frame, if possible. 
10 Moreover, in the first embodiment, only information on a position of 

a title frame is stored in title frame information. In this case, for example, 
if a different file is deleted or moved into a different place after the 
different file is specified, there is a risk that the title frame cannot be read 
out. 

15 In a second embodiment described below, such a problem is 

considered: A plurality of still pictures or a plurality of moving picture 
sequences can be specified as a title frame and in addition, even when a 
different file is specified as a title frame and the different file is deleted, the 
title frame can be decoded without causing any problem. To be brief, in an 

20 apparatus of the second embodiment, the above described problems are 
solved by enabling provision of a plurality of parts each corresponding to 
the management heading 32 of the first embodiment and storage of an 
image data itself constituting a corresponding title frame in the parts each 
corresponding to the management heading 32. 

25 Referring to Fig. 17, an image managing apparatus 180 according to 

the second embodiment is different from the image managing apparatus 50 
of the first embodiment shown in Fig. 3 in that it includes a title frame 
analyzing/generating section 190 including a title file name storing section 
70; a title reference frame position storing section 72; and a title frame 

30 position storing section 74, as well as: a bit stream storing section 192 

extracting a bit stream constituting a title image from a file from which a 
title is extracted and encoding the bit stream to store and output the 
encoded bit stream instead of the title frame analyzing/generating section 
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62 of Fig. 3; and that an index information attaching section 194 for storing 
the bit stream outputted from the bit stream storing section 192 in title 
frame information to attach the bit stream to a multimedia information file 
is included instead of the title frame information attaching section 64 of Fig. 
5 3. 

The other elements of the image managing apparatus 180 are the 
same as corresponding elements of the image managing device 50 shown in 
Fig. 3. The corresponding elements are labeled with the same reference 
numerals. Their names and functions are the same in Figs. 3 and 17. 
10 Hence, detailed description thereof is not repeated here. 

A bit stream extracted/stored by the bit steam storing section 192 
may be any of the following: all of specified files, all of data obtained by 
decoding all data included in a specified file, data obtained by re-encoding 
part or all of a specified file according to a different encoding mode and part 
15 of data of the user. 

Fig. 18 shows a format of a title frame specifying portion of a 
multimedia information file of the second embodiment. The title frame 
specifying portion includes the number of title elements. The number of 
title elements indicates the number of title frames specified by the title 
20 frame specifying portion. 

The number of title elements are followed by the same number of 
pieces of title frame specifying information. 

Title frame specifying information includes; a reference/embedding 
flag indicating whether the title frame specifying information is constituted 
25 of information for referring to a title frame, or the title frame itself 
embedded in the title frame specifying information; and title frame 
information whose contents are different according to a value of the 
reference/embedding flag. 

When a reference/embedding flag is of a value indicating "reference," 
30 a title frame information, as in the case of the first embodiment includes: a 
title name; a title reference frame position; a title leading frame position; 
and a title tail frame position. When a reference/embedding flag is of a 
value indicating "embedding," a title frame information includes: a 
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embedding length indicating a length of a title frame embedded in the title 
frame information; a coding system information specifying a coding system 
of an embedded title frame; and a bit stream constituting a title frame itself. 

Figs. 19 and 20 show an example structure of a multimedia 
information file according to the second embodiment. Referring to Figs. 19 
and 20, the multimedia information file 200 includes: a title frame 
specifying portion 210; and a multimedia data constituted of I frames and P 
frames. 

The title frame specifying portion 210 includes: the number of title 
elements 212; first title frame information 214; second title frame 
information 216; and third title frame information 218. In this example, a 
number "3" is stored in the number of title elements 212 and, according to 
the number "3", three title frame information parts constituted of the first 
to third title frame information 214 to 218 are provided. The first title 
frame information 214 refers to first title frames 224 consisting of two P 
frames and one I frame. The third title frame information 218 refers to 
third title frames 220 consisting of two P frames. The second title 
information 216 includes a title frame embedded therein as described later. 

Referring particularly to Fig. 20, the first title information 214 
includes: a first reference/embedding flag 230; a first title file name 232; a 
first title reference frame position 234; a first title leading frame position 
236; and a first title tail frame position 238. The first 

reference/embedding flag 230 stores a value indicating "reference." The first 
title file name 232 stores NULL. The first title reference frame position 
234 stores a position of the second I frame prior to the leading P frame of 
the first title frame 224. The first title leading frame position 236 stores 
an offset between the leading P frame of the first title frame 224 and the 
above described I frame. The first title tail frame position 238 stores an 
offset from a position of the leading P frame of the first title frame 224 to a 
position of the last I frame thereof. Contents of the datas are the same as 
those described in connection with the first embodiment. Hence, detailed 
description thereof is not repeated here. 

The third title frame information 218 as well is similar to the first 
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title frame information 214. 

In contrast, the second title frame information 216 includes: a second 
reference/embedding flag 250; a coding system information 252; and an 
embedded title frame 254. A value of the second reference/embedding flag 
5 250 is a value expressing "embedding." The coding system information 252 
is information specifying a coding system of the embedded title frame 254. 
The embedded title frame 254 may be either data obtained by re-encoding 
part of data of the title frame specifying portion 210 itself or data obtained 
by encoding contents of a different file. The coding system this time is 
10 required to coincide with a coding system shown in the coding system 
information 252. 

By preparing the title frame specifying portion 210 in such a format, 
contents of the title frame specifying portion 210 can be expressed with a 
plurality of title images. Hence, contents of a multimedia information file 

15 is advantageously easier to understand than in the case of the first 
embodiment. Furthermore, in the second embodiment, a bit stream 
expressing an image of title frame can be stored in title frame information. 
Hence, when a different file is specified as a title frame, contents of a 
multimedia information file can be correctly displayed even if the different 

20 file is deleted or moved. Moreover, since a coding system for a bit stream 
can be specified, an information amount of a title frame can be suppressed 
small with a coding system having a higher compression ratio even when 
an original image constituting the title frame is large and thereby, has a 
large information amount. In this case, a title frame is not necessary to be 

25 of a high quality image since it has only to be understood what contents of 
a multimedia information file are. 

According to the present invention, as described above, in a case 
where a title frame expressing contents of a multimedia file is prepared, 
even a frame other than an I frame can be specified as a title frame. 

30 Furthermore, since not only a still picture, but also a moving picture can be 
specified as a title frame, contents of a file can be identified with more ease. 

Besides, when a plurality of title frames can be specified, contents of 
a multimedia file can be expressed in a variety of ways; therefore, the 
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contents thereof is understandable with more ease. Moreover, by 
embedding a bit stream of an image of a title frame in title frame 
information itself, a different file can be specified as a title frame such that 
the title frame can be correctly displayed even when the different file is 
deleted. 

Industrial Applicability 

According to an image managing apparatus and an image managing 
method of the invention, as described above, contents of many of 
multimedia files can be identified with ease by any person using display of 
a title frame, wherein there is no limitation on a title frame which can be 
specified. Hence, the image managing apparatus and the image managing 
method are suitable for file management in many fields in which there is 
demands for managing multimedia information, such as a private 
multimedia information file management, medical image file management, 
file management in broadcasting business and multimedia data file 
management required for various research fields as an assistant tool for a 
research. 
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CLAIMS 

1 . A method of managing a multimedia file managing said 
multimedia file with index information, multimedia data of said 
multimedia file being able to be managed in each prescribed management 
unit, including the steps of: 

generating said index information including a source identifier 
expressing a source having one or more of said management units 
associated with said multimedia file as a title frame, positions of a leading 
frame and tail frame of said title frame in said source, and a position of a 
reference frame for decoding said leading frame; and 

recording said index information onto a recording medium, attaching 
said index information to said multimedia file. 

2. (amended) A managing method for a multimedia file managing 
said multimedia file with index information, multimedia data of said 
multimedia file being able to be managed in each prescribed management 
unit, including the steps of: 

causing a user to specify one or more of said management units 
associated with said multimedia file as a title frame; 

generating index information in which a bit stream obtained by 
encoding a specified title frame and encoding information indicating a 
system for the encoding are embedded; and 

recording said index information onto a recording medium, attaching 
said index information to said multimedia file. 

3. (amended) The managing method for a multimedia file according 
to claim 2, wherein said prescribed management unit is a frame of an 
image. 

4. The managing method for a multimedia file according to claim 1 
or 2, wherein 

said step of generating index information includes a step of 
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generating a plurality of pieces of index information and 

said recording step includes a step of recording said plurality of 
pieces of index information and information for specifying the number of 
said pieces of index information onto a recording medium, attaching said 
5 plurality of pieces of index information and said information for specifying 
the number of said pieces of index information to said multimedia file. 

5. The managing method for a multimedia file according to claim 1, 
further including the steps of: 

10 causing a user to specify one or more of management units associated 

with said multimedia file as a title frame; and 

generating second index information in which a bit stream obtained 
by encoding a specified title frame is embedded, 

wherein said recording step including a step of recording said index 

15 information and said second index information onto a recording medium 
together with flags indicating kinds of said index information and said 
second index information, respectively, attaching said index information 
and said second index information to said multimedia file together with 
said flags indicating kinds of said index information and said second index 

20 information. 

6. A managing apparatus for a multimedia file managing said 
multimedia file with index information, multimedia data of said 
multimedia file being able to be managed in each prescribed management 

25 unit, including: v 

an index information generating section generating index 
information including a source identifier expressing a source having one or 
more of said management units associated with said multimedia file as a 
title frame, positions of a leading frame and tail frame of said title frame in 

30 said source and a position of a reference frame for decoding said leading 
frame; and 

an index information attaching section recording said index 
information onto a recording medium, attaching said index information to 
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said multimedia file. 

7. (amended) A managing apparatus for a multimedia file 
managing said multimedia file with index information, multimedia data of 

5 said multimedia file being able to be managed in each prescribed 
management unit, including: 

a frame specifying section forcing a user to specify and extract one or 
more of said management units associated with said multimedia file as a 
title frame; 

10 an index information generating section generating index 

information in which a bit stream obtained by encoding an extracted title 
frame and encoding information indicating a system for the encoding are 
embedded; and 

an index information attaching section recording said index 

15 information onto a recording medium, attaching said index information to 
said multimedia file. 

8. The managing apparatus for a multimedia file according to claim 
6 or 7, wherein said multimedia file is an image file. 

20 

9. (amended) The managing apparatus for a multimedia file 
according to claim 8, wherein said prescribed management unit is a frame 
of an image. 

25 10. The managing apparatus for a multimedia file according to 

claim 6 or 7, wherein said index information generating section generates a 
plurality of pieces of index information and 

said index information attaching section records said plurality of 
pieces of index information and information for specifying the number of 

30 said pieces of index information onto a recording medium, attaching said 
plurality of pieces of index information pieces and said information for 
specifying the number of said index information pieces to said multimedia 
file. 
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11. The managing apparatus for a multimedia file according to 
claim 6, wherein said index information generating section generates said 
index information including said source identifier specifying a title frame 

5 having one or more of said management units in said multimedia file, 

positions of a leading frame and tail frame of said title frame and a position 
of a reference frame for decoding said leading frame. 

12. The managing apparatus for a multimedia file according to 

10 claim 6, wherein said index information generating section generates said 
index information including said source identifier specifying a title frame 
having one or more of said management units in a second multimedia file 
different from said multimedia file, positions of a leading frame and tail 
frame of said title frame and a position of a reference frame for decoding 

15 said leading frame. 

13. The managing apparatus for a multimedia file according to 
claim 6, further including: an index information specifying section causing 
a user to specify one or more of said management units associated with said 

20 multimedia file as a title frame, 
wherein 

said index information generating section generating second index 
information in which a bit stream obtained by encoding a specified title 
frame is embedded and 

25 said index information recording section recording said index 

information and said second index information onto a recording medium 
together with flags indicating kinds of said index information and said 
second index information, respectively, attaching said index information 
and said second index information to said multimedia file together with 

30 said flags indicating kinds of said index information and said second index 
information. 



14. (added) A managing method for a multimedia file managing 
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said multimedia file with index information, including the steps of: 

generating index information including a source identifier expressing 

a still picture file different from said multimedia file; and 

recording said index information onto a recording medium, attaching 
5 said index information to said multimedia file. 

15. (added) A managing apparatus for a multimedia file managing 
said multimedia file with index information, including: 

an index information generating section generating index 
10 information including a source identifier expressing a file different from 
said multimedia file; and 

an index information attaching section recording said index 
information onto a recording medium, attaching said index information to 
said multimedia file. 



- 29/1 - 



ABSTRACT 



A managing method for a multimedia file includes the steps of: 
generating index information including a source identifier expressing a 
source having one or more of management units associated with the 
multimedia file as a title frame, positions of a leading frame and tail frame 
of the title frame in the source, and a position of a reference frame for 
decoding the leading frame; and recording the index information onto a 
recording medium, attaching the index information to the multimedia file. 
The managing method for a multimedia file may include the steps of: 
causing a user to specify one or more of the management units associated 
with the multimedia file as a title frame; generating index information in 
which a bit stream obtained by encoding a specified title frame is embedded, 
and recording the index information onto a recording medium, attaching 
the index information to the multimedia file. 
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DECLARATION AND POWER OF ATTORNEY 

As a below named inventor, I hereby declare that: My residence, post office address and citizenship are as stated below 
next to my name. I believe I am the original, first and sole inventor (if only one name is listed at 201) below or an original, first 
and joint inventor (if plural names are listed at 201-208 below) of the subject matter which is claimed and for which a patent is 
sought on the invention entitled: 

METHOD AND APPARATUS FOR MANAGING MULTIMEDIA FILE 



which is described and claimed i 



□ the specification attached hereto. 

□ m the specification in U.S. Application Serial Number 09/786,779 , filed on March 8, 2001 . 

Cj m the specification in PCT international application Number PCT/JP99/04830 

ffi, filed on September 6, ; and was amended on . 

m 1999 

yu 

tjj I hereby state that I have reviewed and understand the contents of the above identified specification, including the claims, 
a&Iamended by any amendment referred to above. I acknowledge the duty to disclose information which is material to the 
examination of this application in accordance with Title 37, Code of Federal Regulations, § 1.56(a). I hereby claim foreign 
priority benefits under Title 35, United States Code, §119 of any foreign application(s) for patent or inventor's certificate listed 
below and have also identified below any foreign application for patent or inventor's certificate having a filing date before that of 
application on which priority is claimed. 



Prior Foreign/PCT Applications and Any Priority Claims Under 35 U.S.C. 119: 


Application No. 


Filing Date 


Country 


Priority Claimed 
Under 35 
U.S.C. 119? 


10-253385(P) 


September 8, 1998 


Japan 


SYES □ NO- 
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□YES □ NO- 
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□YES DNO 








□YES DNO 
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I hereby claim the benefit under 35 U.S.C. §120 of any United States application(s) or PCT international applications) 
designating the United States of America that is/are listed below, and, insofar as the subject matter of each of the claims of this 
application is not disclosed in that/those prior application(s) in the manner provided by the first paragraph of 35 U.S.C. §112, I 
acknowledge the duty to disclose material information as defined in 37 CFR § 1.56(a) which occurred between the filing date of 
the prior application(s) and the national or PCT international filing date of this application: 



Prior U.S. Applications or PCT International Applications Designating the U.S-Benefit Under 35 U.S.C. §120 


U.S. Applications 


Status (Check One) 


Application Serial No. 


U.S. Filing Date 


Patented 


Pending 


Abandoned 
































PCT Applications Designating the U.S. 




r- Application No. 


Filing Date 


U.S. Serial No. Assigned 













































~ CLAIM FOR BENEFIT OF PRIOR U.S. PROVISIONAL APPLICATION(S) 

% (35 U.S.C. § 119(e)) 

J 1 '" I hereby claim the benefit under Title 35, United States Code, § 119(e) of any United States provisional application(s) 
listed below: 



Applicant 


Provisional Application Number 


Filing Date 















POWER OF ATTORNEY: As a named inventor, I hereby appoint the following attorney(s) with full powers of association, 
substitution and revocation to prosecute this application and transact all business in the Patent and Trademark Office connected 
therewith. 

' Sewall P. Bronstein (Reg. No. 1 6.919) 
David G. Conlin (Reg. No. -27.026) 

George W. Neuner (Reg. NoT ?.6 Qfi4> 
Ernest V. Linek (Reg. No. 29,822) 



Linda M. Buckley (Reg. No. 31,003) 

Ronald I. Eisenstein (Reg. Nri r3t)T628) 

Henry D. Pahl, Jr. (Reg. No. 20,438)__ 

Peter J. Manus (Reg. No. 26,766) 



SEND CORRESPONDENCE TO: 


DIRECT TELEPHONE CALLS TO: 


Dike, Bronstein, Roberts & Cushman, LLP 








Boston, Massachusetts 02109 


(617) 523-3400 
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OF INVENTOR 


SHIOi_ 


FIRST NAME 

Masahiro 


MIDDLE NAME 


RESIDENCE-2T" 
CITIZENSHIP 


CITY 

Chiba-shi t p 


STATE OR FOREIGN COUNTRY 

Chiba , Japan 


COUNTRY OF CITIZENSHIP 

Japan 


POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS \ \ 

2-24-/7-A101, Honda-cho, 
Midori -ku 


CITY 

Chiba-shi 


STATE OR COUNTRY AND ZIP CODE 

Chiba 266-0005 Japan 



FULL NAME 
OF INVENTOR 


LAST NAME 

HIBI 


FIRST NAME 

Keiichi 


MIDDLE NAME 


RESIDENCE & 
CITIZENSHIP 


CITY 

Matsudo-shi Y^rsV. D 


STATE OR FOREIGN COUNTRY 

Chiba , Japan 


COUNTRY OF CITIZENSHIP 

Japan 


POST OFFICE 


POST OFFICE ADDRESS \ 

3-328-B211, Shinmatsudo 


CITY 

Matsudo-shi - 


STATE OR COUNTRY AND ZIP CODE 

Chiba 270-0034 Japan 
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Toshio 
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RESIDENCE & 
CITIZENSHIP 


CITY 

Ichihara-shi K0(/3 


STATE OR FOREIGN COUNTRY 

Chiba, Japan 


COUNTRY OF CITIZENSHIP 

Japan 




ADDRESS 


POST OFFICE ADDRESS / f 

2560-1-G101, Goi 


CITY 

Ichihara-shi 


STATE OR COUNTRY AND ZIP CODE 

Chiba 290-0056 Japan 
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I hereby further declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further, that these statements were made with the knowledge that willful^ false 
statements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United 
States Code, and that such willful false statements may jeopardize the validity of the application or any patent issued thereon. 
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